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(54) Title: HIGH SPEED DIGITAL VIDEO SERIAL LINK 

(57) Abstract 

A system for bi-directional digital serial communi- 
cation and control of remote units including video cameras 
and input/output devices in machine vision systems. The 
communication system includes a main processor, com- 
munication hubs and remote units. The system is capable 
of monitoring and controlling the remote units in real-time 
while receiving video data images from the remote video 
cameras. Digital signals are transmitted in two different 
protocols; one for data communications, and one for con- 
trol communications. 
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HIGH SPEED DIGITAL VIDEO SERIAL LINK 

5 Technical Field of the Tnventjftn 

The present invention relates generally to high speed digital serial 
communication and in particular to high speed digital communication for video 
data signals and control. 

Background of the Invention 
10 In conventional machine vision communication and control systems, a 

processor is connected to remote devices such as video cameras using a cable 
having numerous conductors. The cable includes multiple control lines for 
controlling operations of the camera. These operations can include focusing the 
camera, positioning the camera, and capturing a picture. The cable also includes 
1 5 data, synchronization and timing lines for transmitting video signals from the 
camera to the processor and additional lines for supplying power to the camera. 

Different control systems have been used to control a plurality of 
cameras. One system uses a plurality of cameras, each requiring a separate 
controller and a separate communication cable. This system becomes cost 
20 prohibitive to implement as the number of remote cameras increases. In another 
system, one controller can communicate with more than one camera. This 
system, however, requires that all cameras be the same type and that only one 
camera acquire an image at a time. Both of these systems have difficulty 
achieving the speed and flexibility required to control a plurality of cameras 
25 simultaneously and are limited in the number of cameras which can be 

controlled. In a manufacturing setting where real-time control of a number of 
different devices is needed, such conventional systems are impractical and often 
undesirably expensive. 

The distance which a controller and camera can be separated is limited by 
30 the cost and operating characteristics of the cable. A cable having numerous 
conductors is expensive to purchase, install and maintain. Further, most video 
cameras' output signals are in an analog format which is susceptible to noise and 
attenuation losses, distortion, cross talk and ringing over long transmission cable 
distances. The cameras, therefore, must be located in proximity to the controller. 
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further reducing the flexibility of such systems. A typical maximum distance 
between a controller and a camera is approximately 100 feet. 

A further disadvantage of conventional systems is poor interchangeability 
of different types of cameras. That is, because a camera is connected to the 
5 controller with a specific cable, changing a camera may require a cable of a 
different configuration. If the new camera uses a different communication 
format, further modifications to the controller are required. Finally, operating 
characteristics which vary among cameras such as horizontal and vertical timing 
cannot be easily adjusted remotely. 

1 0 For the reasons stated above, and for other reasons stated below which 

will become apparent to those skilled in the art upon reading and understanding 
the present specification, there is a need in the art for a fast, flexible and 
inexpensive communication and control system for video cameras and other 
remote devices. 

15 Siimmary of the Invention 

The above-mentioned problems with communication and control systems 
and other problems are addressed by the present invention and which will be 
understood by reading and studying the following specification. A 
communication and control system is described which provides real-time bi- 
20 directional communication and control of a plurality of remote devices, such as 
video cameras. 

The present invention provides a high speed digital serial communication 
and control system, and corresponding methods of operation, for use in machine 
vision systems. The invention allows for real-time remote control of cameras 

25 and other input/output devices. The digital transmission of video data can 
include data error checking and have more noise immunity than conventional 
systems. The present invention uses simpler, cheaper cables, increases the 
distance between the remote units and a main processor, allows for the easy 
mixing of camera types and provides the option of expanding the system by 

30 adding additional secondary hubs and cameras. The present invention simplifies 
the main processor and allows for the simultaneous acquisition of images from a 
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plurality of remote video cameras. The invention allows a plurality of remote 
units to communicate with a main processor either with or without an 
intermediate communication hub. The remote units can be video cameras 
transmitting digital signals. Video cameras transmitting analog signals can be 
5 used, provided an intermediate communication hub is also used. 

In particular, the present invention describes a vision control system 
using bi-directional high speed serial digital transmissions. The system 
comprises a main processor for receiving and transmitting packaged digital data 
or control signals, a primary communication hub having a first interface and a 
10 plurality of second interfaces, the first interface connected to the main processor 
through a serial communication bus. and a plurality of remote video cameras 
having a third interface connected to one of the second interfaces. The third 
interface comprises a transmitter for transmitting packaged digital data or control 
signals and a receiver for receiving packaged digital signals. The primary 
1 5 communication hub manages communications between the remote video 

cameras and the main processor and responds to high priority communications. 
In an alternate embodiment, at least one remote input/output unit is connected to 
one of the second interfaces allowing the main processor to communicate with 
any variety of remote devices. 
20 In another embodiment, at least one secondary communication hub is 

connected to the primary communication hub for managing communications 
between the primary communication hub and additional remote video cameras. 

The packaged digital video data signals comprise a source address code 
for identifying an address origin of the digital video data signal, a destination 
25 address code identifying a final address destination of the digital video data 

signal, a priority code identifying a priority of the transmission, and digital video 
data. The digital video data signals can further include a data error detection 
code for detecting errors in the digital video data, and a device identification 
code to identify a type of video camera originating the transmission. 
30 The packaged digital control signals comprise a source address code for 

identifying an address origin of the digital control signal, a destination address 
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code identifying a final address destination of the digital control signal, a priority 
code identifying a priority of the transmission, and digital control commands. 

In still another embodiment, a vision control system using bi-directional 
high speed serial digital transmissions comprises a main processor, 
5 communication hub and a plurality of remote units. The main processor 

comprises a receiver for receiving packaged digital signals including a header 
and either digital data or control signals, a memory for storing the received v 
digital signals, and a transmitter for transmitting packaged serial digital signals. 
The communication hub at least distributes transmissions between the main 

1 0 processor and a plurality of remote video cameras. The hub comprises a main 
processor interface connected to the main processor for communicating with the 
main processor and a plurality of remote video camera interfaces connected to 
the plurality of remote video cameras for communication with the plurality of 
remote video cameras. A communication hub interface is located at each of the 

1 5 remote video cameras for communication with the communication hub. Another 
embodiment describes a digital communication system comprising at least one 
camera and a processor. 

Another embodiment describes a method of bi-directional 
communication in a vision control system between a plurality of remote video 

20 cameras and a main processor. The method comprising the steps of serially 

transmitting digital signal packets comprising digital data or control signals and 
a first header from the remote video cameras to a communication hub, using the 
communication hub, multiplexing the digital signal packets from the remote 
video cameras, evaluating a destination address identifier included in the first 

25 header and transmitting at least some of the digital signal packets to the main 
processor, serially transmitting digital signal packets including a second header 
from the main processor to the communication hub, and using the 
communication hub, evaluating a destination address identifier included in the 
second header and transmitting at least some of the packets to at least one the 

30 remote video cameras. 
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Still another embodiment includes the steps of transmitting a high 
priority digital signal packet comprising a header having a high priority identifier 
from a camera to the communication hub, interrupting a digital signal packet 
being transmitted by the communication hub to the main processor in response 
5 to the high priority digital signal packet and transmitting the high priority digital 
signal packet from the communication hub to the main processor, and 
completing the transmission of the interrupted digital signal packet. 

Another embodiment includes a communication protocol for 
transmissions between a plurality of remote video cameras and a main processor. 
1 0 The protocol comprises a beginning code indicating a beginning of a 

transmission, a source address indicating an address of the transmission origin, a 
destination address indicating a destination of the transmission, a priority code 
indicating a priority of the transmission, data or control codes, and an ending 
code indicating the end of the transmission. 
15 Brief Description of the Drawings 

Figure 1 is a block diagram of the digital serial link system of the present 
invention including a main processor, communication hub and remote units; 

Figure 2 is an alternate embodiment of the present invention including a 
main processor and a remote unit; 
20 Figure 3 is a more detailed diagram of Figure 1 : 

Figure 4 illustrates a typical communication from the communication hub 
to the main processor of Figure 1 ; 

Figure 5 is a block diagram of a main controller of the main processor of 
Figure 1: 

25 Figure 6 is a detailed block diagram of a field programmable gate array 

(FPGA) controller of the main controller in Figure 5; 

Figure 7 is a block diagram of the main processor interface of the 
communication hub of Figure 1 ; 

Figure 8 is a detailed block diagram of a FPGA controller of the interface 
30 in Figure 7: 

Figure 9 is a block diagram of the remote unit interface of the 
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communication hub of Figure 1 ; 

Figure 10 is a detailed block diagram of a FPGA controller of the 
interface in Figure 9; 

Figure 1 1 is a block diagram of the interface of a remote camera of 
5 Figure 1; 

Figure 12 is a detailed block diagram of a FPGA controller of the 
interface in Figure 1 1 ; 

Figure 1 3 is a star configuration of a number of remote cameras and a 
communication hub of the present invention; 
10 Figure 14 is a bi-directional daisy chain configuration of a number of 

remote cameras and a communication hub of the present invention; and 

Figure 15 is a single direction daisy chain configuration of a number of 
remote cameras and a communication hub of the present invention. 

Detailed Description of the Invention 

1 5 In the following detailed description of the preferred embodiment, 

reference is made to the accompanying drawings which form a part hereof and 
in which is shown by way of illustration specific preferred embodiments in 
which the inventions may be practiced. These embodiments are described in 
sufficient detail to enable those skilled in the art lo practice the invention, and it 

20 is to be understood that other embodiments may be utilized and that logical. 

mechanical and electrical changes may be made without departing from the spirit 
and scope of the present inventions. The following detailed description is* 
therefore, not to be taken in a limiting sense, and the scope of the present 
inventions is defined only by the appended claims. 

25 The digital serial link (DSL) of the present invention is a vision control 

system having bi-directional serial communications bus for transmitting digital 
data and control signals between remote video cameras and a main processor. 
The digital video data can be used by the main processor to generate a response 
based on the content of the video data. That is, the main processor can include a 

30 means for analyzing the video data so that the DSL can operate in a machine 
vision or image processing system. 
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In the preferred embodiment, shown in Figure 1, the DSL system has a 
main processor 100 and remote units 102, 106 which are connected to the main 
processor through a primary communication hub 104. The remote units can be 
video cameras 102, or input/output devices such as sensors, controls or strobe 
5 lights, generally referred to as remote units 106. Other remote units are 
contemplated including, but not limited to, personal computers, devices 
connected with RS232, programmable logic controllers and industrial control 
networks. It will be understood that any remote unit capable of receiving signals 
and generating output signals can be used in the present system. The primary 
1 0 hub 104 can also communicate with one or more secondary hubs 108. The 
secondary hubs function in a similar manner as the primary hub and are 
connected to additional remote units to thereby increase both the system's total 
capacity of remote units and the distance between remote units and the main 
processor. Distances of up to 250 feet can be achieved using low cost twisted 
1 5 pairs of wires between a primary hub and either a secondary hub or a remote 

unit. This distance can be greatly increased using higher cost links such as fiber 
optic lines. The primary hub multiplexes data from the remote units and 
secondary hubs into a serial data stream connected to the main processor 1 00 
over communication link 101 . The primary hub also distributes and processes 
20 the data transmitted from the main processor to the appropriate remote unit. 

The communication link 101 between the main processor 100 and the 
primary hub 104 is preferably two twisted pairs of wires, with one pair being 
used for transmissions from the main processor to the primary hub and the other 
pair used to transmit from the primary hub to the main processor. Alternatively. 
25 fiber optic, coax cables or other communication media such as radio 

transmissions can be used for the communication link. The use of two separate 
data paths allows for independent and simultaneous communication in either 
direction, thereby providing the option of controlling a camera while monitoring 
the video signal transmitted by that camera. Alternatively, such duplex 
30 communication can be achieved with frequency multiplexing or other such 
techniques. 
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In an alternate embodiment where only one remote unit is used, as shown 
in Figure 2, one remote unit, eg. a camera 102, can be connected directly with a 
main controller 1 10 of the main processor 100. The communication link 1 14 in 
this configuration comprises two twisted pairs, one pair for each communication 
5 direction and a pair of power supply lines (or similar communication connection 
for a different type of remote unit) to exchange digital video signals from the 
camera and control signals from the main processor. 

Referring to Figure 3, the preferred embodiment is shown in further 
detail. The main processor 100 has a main controller 1 10 for transmitting data to 

10 the primary hub and receiving data transmitted by the primary hub over link 101. 
The primary hub 104 has a main controller interface circuit 1 18 for transmitting 
data to the main processor and receiving data from the main processor. A 
plurality of remote unit interface circuits 120 connect the remote units 102, 1 06 
and secondary hubs 1 08 to the primary hub 1 04. Each remote camera has an 

1 5 interface circuit 1 12 for processing data transmitted to and received from a hub. 
Direct input/output device 122 can communicate to the hub 104 directly without 
using a high speed serial link. These I/O devices can provide data directly to the 
hub which may then be used or further transmitted over the DSL. 

The secondary hubs 108 are similar to the primary hub in that they have 

20 an interface circuit 1 1 8 for communication with the primary hub 1 04 and remote 
unit interface circuits 120 for communication with remote units. Before 
describing the interface circuits of the main processor 100, primary hub 104 and 
remote units, the protocol of digital serial transmissions in the system is 
described. 

25 Communication Protocol 

Referring to Figure 4, data is communicated between the primary hub, 
the main processor and the remote devices using two distinct formats; a control 
packet, and a data packet. The control packet is a fixed length transmission used 
to provide control data. This control data can contain control information from 

30 the main processor which is directed to a remote unit to control, for example, a 
video camera. The control packet can be used to control operating features of 
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the video camera such as gain, offset, shutter speed, zoom, focus, and iris 
aperture. The control packet can also contain requests from a remote unit for a 
particular service, for example, a camera may request that a strobe light be 
activated to assist in obtaining a video image. The control packet is preferably 
5 81 bits long comprising nine bytes (bits 1-8) and an appended ninth bit as shown 
in Table 1. 



Bit 9 


Bits 8 - 1 


1 


Start of control packet 


0 


Source Address 


0 


Destination Address 


0 


(1 bit) priority code/ (7 bit) device type 


0 


(3 bits) spare / (5 bit) data type 


0 


Data type index 


0 


Real Time Clock (lower byte) 


0 


Real Time Clock (upper byte) 


1 


End of control packet 



Table 1 

20 The ninth bit is used as a signaling bit to identify the transmission of control 

codes. A logical 1 indicates that a control code is included in the accompanying 
byte. The start of control packet is indicated by a unique identifier control code 
used to notify the receiver that a control packet is being transmitted. A different 
unique identifier can be used to indicate a high priority transmission, as 

25 described in greater detail below. That is. a high priority transmission and a 
standard priority transmission would have different "start of control packet" 
indicators. The second byte of the control packet contains the address of the 
original transmitting source of the control packet and the third byte contains the 
address of the final destination of the packet. A one bit priority code is included 
30 in the fourth byte of the control packet to indicate the priority of the 
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communication. If the priority bit is a logical 1 the communication is high 
priority and a logical 0 indicates low priority. The remaining seven bits of the 
fourth byte are used to identify the type of device transmitting data, for example, 
a digital camera, line scanner or I/O device. The next byte contains five bits 
5 identifying the type of control being transmitted, for example, camera control. 
Three spare bits are also included in this byte. The data type index byte provides 
a detailed description of the control process desired. If the data type indicates a 
camera control, the data type index can be used to reset the camera, trigger the 
camera, or start and stop the transmission of video data. The data type and data 

1 0 type index can be considered a category and subcategory, respectively, thereby 
providing a means to communicate a multitude of control commands and 
requests. The real time clock is a 16 bit word contained in two bytes and used to 
identify the time in which the transmission was initiated. The real time clock 
can be used to monitor the efficiency of the DSL system by tracking the elapsed 

1 5 time between transmission and receipt. The last byte is a unique control code to 
identify the end of the control packet transmission. 

The second communication format, a data packet, is used to provide 
variable length data from the transmitting device. In a transmission originating 
in a remote unit, such as a video camera, the data is preferably a video image. 

20 Alternatively, in a transmission originated at the main processor, the data is 

preferably information needed by a remote unit. The data packet can contain up 
to 2048 bytes of data in addition to 12 bytes of control information. The data 
packet format is illustrated in Table 2. 
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5 



15 



Bit 9 


Bits 8-1 


1 


Start of data packet 


0 


Source address 


0 


Destination address 


0 


Priority (1 bit) / device type (7 bits) 


0 


Data type (5 bits) / data length (3 bits) 


0 


Lower 8 bits of data length 


0 


Real time clock (lower byte) 


o 


Real time clock (upper byte) 


1 


Start of data 


0 


Data 




1 z,U4o bytes 




End of data 


0 


Cyclic redundancy check (lower byte) 


0 


Cyclic redundancy check (upper byte) 




End of data packet. 



Table 2 



The first four bytes of the data packet are similar to the first four bytes of the 
20 control packet. As with the data transmissions, a separate unique identifier can 
be used to indicate a high priority transmission. Therefore, a high priority 
transmission and a standard priority transmission would have different "start of 
data packet" indicators. The three spare bits of the fourth byte in the control 
packet are used in the data packet as the upper three bits of an 1 1 bit word used 
25 to indicate the length of the data being transmitted. The ninth bit of the data 

packet marks the transmission of a control code with a logic 1 . The ninth bit and 
a unique control code are used to indicate the beginning of the data transmission. 
The data transmission can vary from one byte to 2048 bytes. The length of the 
transmission is primarily dependent upon the type of device transmitting. That 
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is, as seen in Figure 4, standard RS-1 70 video and double speed video transmit 
different length data packages as a result of the resolution of the video image 
captured by each type of video camera. Following the data transmission the 
ninth bit and a unique control code are used to indicate the end of the data 
5 transmission. Two bytes are used for a cyclic redundancy check (CRC). The 
last byte contains unique control code to signal the end of the data packet 
transmission. 

To avoid erroneously processing transmissions from a remote unit, the 
ninth bit and a unique , no-operate r code can be transmitted from the remote unit 
10 which indicates that the unit is not transmitting valid signals. This code, 
therefore, allows a remote unit to stop transmitting valid signals without 
confusing the receiver. When a receiver receives the no-operate code it remains 
in a hold state waiting for the no-operate code to end and valid signals to 
continue. 

1 5 CRC is a standard data communication error detection technique 

incorporating the generation of a code at the transmission and the second 
generation of the code at the receiver using the transmitted data. The receiver 
compares the transmitted CRC and the second generated CRC to determine if 
errors occurred. A further description of CRC can be found in Cypress 

20 Semiconductor Applications Hand Book (April 1994) at 5-105. It will be 

understood by one skilled in the art that alternate error detection and correction 
techniques can be used. 

The priority bit of both packets can be used to send urgent transmissions 
over the DSL. The primary hub typically multiplexes transmissions on a first-in 

25 first-out basis. If a high priority packet is transmitted to the hub, however, the 
hub will insert the packet into a currently transmitted packet. The receiving 
circuitry will trigger on the ninth bit signal and the unique identifier codes to 
retrieve the high priority packet without missing any data from the currently 
transmitted packet. As illustrated in Figure 4, during the transmission of an RS- 
0 1 70 color video data packet, transmission is interrupted and a high priority 
control packet is inserted in the data stream, after which the remaining data 
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packet is transmitted. Real-time control of remote devices can, therefore, be 
achieved. To assist the receiving circuitry in detecting the presence of a high 
priority packet, the start control packet byte and start of data packet can be used 
to indicate the transmission of a priority packet, as described above. 
5 Table 3 illustrates an alternative control packet which eliminates the 

priority bits. All control packets are therefore treated as high priority. The start 
of control packet identifier, however, can be used to identify super high priority 
packets if necessary. Two CRC bytes have been added to the control packet to 
allow for better error checking. Table 4 is an alternate data packet. 

10 



Bit 9 


Bits 8 - 1 


1 


Start of control packet 


0 


Destination Address 


0 


(5 bit) data type / (3 bits) spare 


0 


Data type index 


0 


Real Time Clock (upper byte) 


0 


Real Time Clock (lower byte) 


0 


Source Address 


0 


CRC (upper byte) 


0 


CRC (lower byte) 


1 


End of control packet 



Table 3 
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Bit 9 


Bits 8-1 


1 


Start of data packet 


0 


Destination address 


0 


Data type (5 bits) / data length (3 bits) 


0 


No. Of Data Bytes 


0 


Real time clock (upper byte) 


0 


Real time clock (lower byte) 


0 


Source Address 


1 


Start of data 


0 


Data 




2 2,048 bytes 


1 


End of data 


0 


Cyclic redundancy check (upper byte) 


0 


Cyclic redundancy check (lower byte) 


1 


End of data packet. 



15 

Table 4 

Table 5 illustrates a short data packet which allows small amounts of data 
to be sent. The data is limited to 1 6 bytes. The short data packet can be useful 
for transmitting Input/Output data, configuration data, or status data. 

20 
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Bit 9 


Bits 8-1 


1 


Start of data packet 


0 


Destination address 


0 


Data type (5 bits) / data length (3 bits) 


0 


No. Of Data Bytes 


0 


Real time clock (upper byte) 


0 


Real time clock (lower byte) 


0 


Source Address 


1 


Start of data 


0 


Data 




2 16 bytes 


1 


End of data 


0 


Cyclic redundancy check (upper byte) 


0 


Cyclic redundancy check (lower byte) 


1 


End of data packet. 



Table 5 

Main Controller Inter face Circuitry 
Referring to Figures 5-6, the main controller 1 10 of the main processor 
1 00 is described in detail. As described above, the main controller 1 1 0 connects 

20 the primary communication hub 104 to the main processor. That is, the main 
controller is an interface between the main processor and the rest of the DSL 
system. The controller 1 10 transmits control and data packets to the DSL and 
receives and stores packets for retrieval by the main processor. The control 
packets transmitted to the DSL could, for example, be used to enable different 

25 remote cameras, trigger cameras, request digital video outputs, or run built-in- 
self-tests (BIST) on the remote units. The control commands available are 
limited only by the type of remote units implemented and the above examples 
are not intended to limit the commands available for transmission from the main 
controller. 
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In the up-stream (toward the remote unit) direction, the main processor is 
connected to a DSL control circuit 130 to process upstream packets. The control 
130 regulates upstream transmissions and provides the packets to transmitter 132 
which transmits to a primary hub 1 04 over link 101. The preferred transmitters 
5 of the present system are HOTLink™ CY7B923 transmitters manufactured by 
CYPRESS Semiconductor Inc., San Jose, California. For detailed information 
and operation see HOTLink™ User's Guide (May 1994). In the down-stream 
direction transmissions are received from a primary hub by receiver 1 34 and 
processed by a field programmable gate array (FPGA) 136. It will be understood 

1 0 that a gate array or similar circuitry could be used in place of an FPGA. The 
preferred receivers of the present system are HOTLink™ CY7B933 receivers 
manufactured by CYPRESS Semiconductor Inc., San Jose. California. For 
detailed information and operation see HOTLINK User's Guide (May 1 994). 
The transmissions received will typically be data packets including digital 

1 5 camera video and digital inputs, but other data transmissions are contemplated. 
The FPGA strips the header and CRC information from the received control and 
data packets. The video or input data is stored in memories 138, 140, 142 for 
access by the main processor either directly or through the FPGA. The 
memories are preferably synchronous dynamic random access memories 

20 (SDRAM), but can be any type of memory including video random access 
memories (VRAM). 

The FPGA 136, as seen in Figure 6, comprises a header decoder 144 for 
stripping the header and CRC generator 145 for generating the CRC code from 
received transmissions. The header preferably comprises the source address, 

25 destination address and the priority code of either the control or data packets. 
The CRC from the received transmission is accessible by the main processor 
through buffer 146 to check for errors in the received transmission. A copy of 
the header information is also stored in a buffer 146 for access by the main 
processor 100. Address decoder 150 is used to identify the address of the buffer 

30 which the main processor is accessing. First-in first-out (FIFO) buffer 148 

provides an overflow protection for transferring the digital data to memories 138, 
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140, 142. The address decoder 150, memory select 152, memory address/timing 
1 54, and refresh/memory control 1 56 circuits provide management control 
capabilities for the memories. The main processor, therefore, can select which 
memory is to be used for storing the received data. 
5 Primary Hub Interface Circuitry 

The primary hub 104 comprises a main processor interface 1 1 8 and a 
plurality of remote unit interfaces 120. Figures 7 and 8 illustrate block diagrams 
of the main processor interface 118. In the up-stream direction, transmissions 
from the main processor 100 are received by receiver 1 58 and processed at 
10 FPGA 160. An up-stream transmission intended for remote units is further 
transmitted by transmitter 162 through buffer 164 to all the remote units 
connected to the primary hub. 

The FPGA controller 160, of Figure 7, of the main processor interface 
has an input header decoder 166 to strip the header from the transmission and 
15 store the transmission in FIFO buffer 168. Processor interface 1 70 determines if 
the primary hub is the destination address of the transmission. If the hub is the 
destination address, the transmitted data and header are processed and the 
desired operation indicated in the packet is conducted by the hub. If the hub is 
not the final destination, the received transmission is queued in buffer 1 72 and 
20 re-encoded in encoder 1 74. Down-stream transmissions are processed at 
processor interface 1 70 in substantially the same manner as up-stream 
transmissions. If the main processor is the intended destination, data transfer 
unit 1 76 transmits the signal to the main processor 1 00 through transmitter 1 78. 
I/O interrupt circuit 222 monitors direct I/O devices 122 and couples their 
25 outputs to the DSL. A power supply 1 81 is included in the primary hub to 
provide power to the remote units. 

Each remote unit interface 120 preferably interfaces with two remote 
units, as shown in Figure 9. The remote unit interfaces are modular such that 
additional remote unit interfaces can be added to a hub to increase the number of 
30 remote units connected to the hub, see Figure 3. The modular nature of the 
interfaces allows for easy expansion as a system increases in size. Up-stream 
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transmissions merely pass through the interface and are not further processed. In 
the down-stream direction, however, the remote unit interface 120 has a receiver 
1 80, FPGA controller 1 82 and a memory 1 84 associated with each remote unit 
interfaced. The FPGA 1 82 and memory 1 84 operate substantially the same as 
5 FPGA 136 and memories 138, 140, 142 of the main controller 110. The 

memories allow for the acquisition of multiple images at one time. In addition, 
the memories buffer data rate differences between input and output. Prior art 
systems can only acquire images from a limited number of cameras at one time 
and therefore inhibit image acquisition from other cameras connected to the 

1 0 system. This is a problem where the image may change during the time the 
camera is inhibited. Memory 1 84 allows the cameras to acquire an image 
without delaying the acquisition. The FPGA 182, as seen in Figure 10, has a 
decoder 1 86 which strips the header from the received transmission and stores a 
copy of the header in buffer 1 88. The received transmission is placed in FIFO 

1 5 buffer 1 90 for storage in memory 1 84. The hub processor 220, Figure 7, can 
address buffer 1 88 using address decoder 1 92. The hub processor can also 
control memory 184 through memory control circuit 1 96 and memory 
address/timing circuit 1 94. 

Camera Interface 

20 The following is the preferred embodiment for a remote unit comprising 

a video camera 102. Referring to Figures 1 1 and 12. the camera has an interface 
112 which contains a receiver 198 for receiving transmissions from the primary 
hub 1 04 and a transmitter 202 for transmitting to the primary hub. The interface 
is preferably a separate circuit which can be used with a plurality of different 

25 cameras. An alternative embodiment provides cameras containing the interface 
circuitry. The FPGA controller 200 controls both reception and transmission for 
the camera. Regulator 206 regulates power supplied by the power supply 1 8 1 of 
the primary hub. Analog to digital converter 204 converts an analog video signal 
generated by the camera into a digital video signal for transmission to the 

30 primary hub. 
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The FPGA 200 comprises a header decoder 208 for decoding the header 
and determining if the camera is the intended destination of the received signal. 
Preferably each remote unit has both a unique address and a global address for 
receiving transmissions. The unique address is used for a particular unit, while 
5 the global address is used for all of the remote units. If either address is 

detected, the FPGA processes the signal. A built in self test circuit 210 provides 
the ability to test the camera and transmit the results to the primary hub. To 
transmit digital video data from analog to digital converter 204. CRC generator 
212 produces the CRC code bytes used in the transmitted data packet, as 
1 0 explained above, and encoder 214 encoded the header for the transmission. 
Horizontal timing generator 2 1 6 and vertical timing generator 21 8 are used to 
remotely adjust the timing of the camera depending on the type of camera used. 
It will be recognized that additional operating characteristics of the camera can 
be remotely controlled by the DSL system. Figure 13 illustrates one preferred 
1 5 configuration of remote cameras. A plurality of cameras, cameras 1 -4, are 
arranged in a star configuration. That is, each camera has a separate 
communication link to the primary hub 104 and is independent of the other 
cameras. Figure 14 illustrates an alternative configuration of remote cameras. A 
plurality of cameras, cameras 1-4, are arranged in a bi-directional daisy chain 
20 configuration. That is. the communication hub communicates with the cameras 
over a common link. Figure 15 illustrates another alternate configuration of 
remote cameras. A plurality of cameras, cameras 1-4, are arranged in a single 
direction daisy chain configuration. That is, the communication hub transits to 
one camera and receives from a different camera, with each camera connected in 
25 series. 

Alternately, one skilled in the art will recognize that analog video 
cameras can be used to transmit to a primary or secondary hub using analog 
signals. Because the signals are analog, no analog-to-digital circuitry is needed 
at the camera. The analog signal is transformed into the digital signal as 
30 described above at the remote unit interface 1 20. In this embodiment, the remote 
unit interface 120 comprises components comparable to the converter 204, CRC 



WO 96/31067 PCI7US96/03763 

20 

generator 212 and the encoder 214 as described above. This embodiment allows 
for the economical use of analog cameras by not requiring a user to purchase 
digital camera interfaces. Further, both analog and digital cameras can be used 
in combination in a DSL. 

5 Operation of the DSL System 

Remote Cam era communication 

The DSL communication and control system as described above and 

shown in Figure 1 provides communication between remote units 102, 106, at 

least one communication hub 104 and a main processor 100. The operation of 

10 the communication system is best understood by first examining the down 
stream communication from a remote video camera 1 02. 

The camera interface 112 of Figures 1 1 and 12 receives analog video 
signals from the remote video camera 102 and converts the analog signal to 
digital using converter 204. Converting the analog signal to digital allows 

15 flexibility in camera selection. Different cameras can be used or exchanged 

without requiring extensive changes in cable connections as with a conventional 
system. Further, the horizontal and vertical timing generators 216, 218, as 
described in further detail below, allow for the use of different cameras without 
changing the camera interface 1 12. The digital video signal is received at FPGA 

20 controller 200 where the CRC generator 212 generates the CRC bytes of the data 
packet as shown above in Table 2. The digital video data and CRC are 
combined at the header encoder 214 to generate data packets as shown in Table 2 
above. Alternatively, the FPGA controller 200 can generate control packets as 
previously shown in Table 1 . These control packets preferably request that 

25 either the primary hub 1 04 or the main processor 1 00 perform some function, 
such as trigger a strobe light 106. The communications from the controller 200 
are transmitted to the primary hub 1 04 via transmitter 202. The conductor cable 
between the remote video camera 102 and the primary hub 104 is shielded and 
preferably comprises six conductors; two for serial communication to the hub, 

30 two for serial communication from the hub and two power supply lines. 

Referring to Figures 7 through 10. the transmitted packets from each 
camera are received at the primary hub by receiver 1 80 and processed by FPGA 
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controller 1 82. The header of the packet is decoded at header decoder 1 86 and a 
copy of the header is stored in buffer 1 88. The received packet is stored in the 
FIFO buffer 190 prior to being stored in the memory 184. Address decode 192 
allows the hub processor 220 to read and control buffer 1 88, and control the 
5 storage of the packet to the memory 1 84. I/O interrupt control circuit 222 

monitors interrupt requests from a plurality of interrupt lines INT A through INT 
H associated with the plurality of remote units. As stated above, I/O interrupt 
control circuit 222 monitors direct I/O devices 122. If an I/O device sends a 
signal to the hub, a specific response or operation may be started. For example, 
1 0 a direct sensor may send a signal indicating that a camera acquire a picture. In 
response the hub will send command to the camera to take a picture. The camera 
will then respond back to the hub and request that a strobe be triggered. 

If a transmission from a remote unit is received by the primary hub a 
signal is provided on the corresponding interrupt line and the control circuit 222 
1 5 determines if the transmission is a high priority. A high priority signal is 

processed as described above such that a standard transmission is interrupted 
temporarily. If a high priority control packet is received from a video camera 
requesting that a strobe light be triggered, the primary hub immediately transmits 
a strobe trigger signal to the strobe 106 associated with the requesting camera. 
20 The hub processor 220 controls the multiplexing of the data stored in the 

memories 1 84 of the remote unit interfaces 120 to the FPGA controller 160. As 
seen in Figure 8, the processor interface 170 takes the output from the hub 
processor 220 and relays the data to the high speed data transfer circuit 1 76. The 
digital serial packet is then transmitted to the main processor by transmitter 1 78 
25 via cable link 101 at 330 Mbps (mega bits per second), however, speeds of 660 
Mbps can be used. It will be understood that in speeds in excess of one giga bits 
per second are contemplated. 

The transmission is received by the main controller 1 1 0 of the main 
processor 100 at receiver 134. The header of the received transmission is 
30 decoded at decoder 144 and a copy of the header is stored in the buffer 146. The 
CRC code for received data packets is decoded at decoder 145 and a copy is also 
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stored in buffer 146. The received packet is stored in FIFO buffer 148 prior to 
storage in one of the memory 138, 140, 142. Address decoder 150 allows the 
main processor 100 access to the header and CRC stored in the buffer 146. The 
main processor also controls the storage of the packets to the memory using 
5 circuits 152, 1 54, and 1 56. The main processor evaluates the received CRC code 
to determine if an error occurred in the transmission. 

As seen in Figure 1, secondary hubs 108 can be used to increase the 
number of remote units serviced by one main processor and increase the distance 
between a remote unit and the main processor. This hierarchical structure is 

10 implemented using the same principles as the primary hub, except the secondary 
hub will multiplex the remote units serviced thereby to the primary hub. 

As can be seen, the present invention provides a communication and 
control system for receiving data and control requests from a plurality of remote 
units. Remote units which require immediate attention can be controlled without 

1 5 substantially interrupting communication with other remote units, thereby 
allowing image acquisition from an unlimited number of video cameras. 
Communication hubs can be used to respond to some of the control requests 
from the remote units to reduce the transmissions to the main processor and 
increase the speed of the system. Real-time control can, therefore, be obtained. 

20 As will be seen below, the main processor can receive data from a camera while 
simultaneously controlling that camera. 

Main processor communication 
The communication and control of upstream packets from the main 
processor is best understood starting with Figure 3. A transmission originating 

25 at the main processor 100 is transmitted over the communication link 1 01 to the 
primary hub 104. If the intended receiving address is the primary hub, the 
transmission stops there. If, however, a remote unit 102 is the destination 
address, the transmission is broadcast to all remote units and the intended unit 
acts upon the received transmission. 

30 Referring to Figures 5, 7-9, a communication packet originating at the 

main processor is transmitted over the communication link 1 01 to the primary 
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hub 104 via the DSL control 130 and the transmitter 132. Receiver 158 of the 
main controller interface 1 1 8 receives the transmission packets and relays the 
packets to the FPGA controller 160. The headers of the packets are decoded by 
decoder 166 and the headers and data are stored in FIFO buffer 168. Each 
5 decoded header is evaluated at processor interface 170. If the hub is the 

destination address of the communication, the requested action is performed by 
the hub processor. If, however, the destination address is not the hub, the 
decoded header is transferred to the header encoder 1 74 through data buffer 1 72. 
The re-encoded header and data are transmitted using transmitter 1 62 and buffer 
10 1 64 to all of the remote units over serial data lines OUT A through OUT H. 
Upstream transmissions effectively bypass the remote unit interfaces 120 to 
connect with the serial data conductor lines associated with each remote unit. 

The receiver 198 of each remote camera 102 captures the up-stream 
transmissions and decoder 208 decodes the header. If the destination address 
1 5 matches an address of the remote unit the command code is followed. If the 
address does not match, the transmission is ignored. Each remote unit as 
described above preferably has a unique address and a global address such that 
remote units can be addressed individually or simultaneously. The command 
code can indicate a variety of desired operations, in particular a camera could run 
20 a self test using self test circuit 2 1 0 or the horizontal and vertical timing can be 
adjusted using generators 2 1 6 and 218. It will be understood that a variety of 
operations can be controlled remotely, and are not intended to be limited to those 
described. 

As can be seen, the present invention provides a communication and 
25 control system for transmitting data and control commands to a plurality of 

remote units. The main processor can control either the remote units directly, or 
instruct the primary or secondary hubs to perform a specified operation. Control 
operations can be distributed to increase efficiency and communication speed. 
Real-time communication and control can, therefore, be obtained. The main 
30 processor can receive data from one camera while simultaneously controlling 
another camera. 
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Conclusion 

The present invention provides a high speed digital serial communication 
and control system, and corresponding methods of operation, for use in machine 
vision systems. The invention allows for real-time remote control of cameras 
5 and other input/output devices. The digital transmission of video data can 
include data error checking and has more noise immunity than conventional 
systems. The present invention uses simpler cheaper cables, increases the 
distance between the remote units and a main processor, allows for the easy 
mixing of camera types and provides the option of expanding the system by 

1 0 adding additional secondary hubs and cameras. The present invention simplifies 
the main processor and allows for the simultaneous acquisition of images from a 
plurality of remote video cameras. The invention allows a plurality of remote 
units to communicate with a main processor either with or without an 
intermediate communication hub. The remote units can be video cameras 

15 transmitting digital signals. Video Cameras transmitting analog signals can be 
used, provided an intermediate communication hub is also used. 

Additional refinements can be included in the system without departing 
from the invention. For example, if a packet is received by a hub which is not 
the destination address, the packet will be forwarded without interrupting the hub 

20 processor. Further, hubs can be prevented from communicating directly with 
another hub. In this system each hub will communicate a packet to the main 
processor which will forward the packet to the appropriate destination hub. It 
will be appreciated that packets may pass through an intermediate hub on the 
way to the processor or to the destination hub. Finally, handshaking can be 

25 added between the system devices to reduce communication errors. 
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What is claimed is: 

1 . A machine vision control system using bi-directional high speed serial 
digital transmissions comprising; 

a main processor for receiving packaged digital data or control signals 
5 and transmitting packaged digital data or control signals; 

a primary communication hub having a first interface and a plurality of 
second interfaces, the first interface connected to the main processor through a 
serial communication bus for transmitting and receiving packaged digital data or 
control signals; and 

JO a plurality of remote video cameras having a third interface connected to 

one of the second interfaces for bi-directional communication with the primary 
communication hub; 

the primary communication hub for managing communications between 
the plurality of remote video cameras and the main processor and responding to 

1 5 high priority communications. 

2. The machine vision control system of claim 1 further including at least 
one secondary communication hub connected to one of the plurality of second 
interfaces of the primary communication hub for managing communications 

20 between the primary communication hub and additional remote video cameras. 

3. The machine vision control system of claim 1 further including at least 
one remote input / output unit connected to the primary communication hub for 
at least receiving transmissions from the primary communication hub. 

25 

4. The machine vision control system of claim 3 where the remote input / 
output unit is an industrial control network. 

5. The machine vision control system of claim 3 where the remote input / 
30 output unit is a strobe light. 
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6. A machine vision control system using bi-directional high speed serial 
digital transmissions comprising; 

a main processor for having at least one first interface for receiving and 
transmitting serial packaged digital data or control signals; and 
5 at least one remote video camera having a second interface connected to 

the at least one first interface for bi-directional communication of serial 
packaged digital data or control signals with the main processor. 

7. The machine vision control system of claim 1 or 6 wherein the packaged 
10 digital data signals comprise a source address code for identifying an address 

origin of the digital data signal, a destination address code identifying a final 
address destination of the digital data signal, and digital data. 

8. The machine vision control system of claim 7 wherein the packaged 
1 5 digital data signals further include a data error detection code for detecting 

errors, and a device identification code to identify a type of camera originating 
the transmission. 

9. The machine vision control system of claim 1 or 6 wherein the packaged 
20 digital control signals comprise a source address code for identifying an address 

origin of the digital control signal, a destination address code identifying a final 
address destination of the digital control signal, and digital control commands. 

1 0. The machine vision control system of claim 6 further including at least 
25 one remote input / output unit connected to the main processor for at least 

receiving transmissions from the main processor. 

11. A machine vision control system using bi-directional high speed serial 
digital transmissions between at least a main processor and a communication 

30 hub, the system comprising; 

the main processor comprising a receiver for receiving packaged 
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digital signals including a header and either digital data or control 
signals, a memory for storing the received digital signals, and a 
transmitter for transmitting packaged serial digital signals; 

the communication hub for at least distributing transmissions 
5 between the main processor and a plurality of remote video cameras, the 

communication hub comprising a main processor interface connected to 
the main processor for communicating with the main processor and a 
plurality of remote video camera interfaces connected to the plurality of 
remote video cameras for communication with the plurality of remote 
1 0 video cameras, 

the main processor interface comprising a receiver for 
receiving digital transmissions from the main processor, a 
processor, a first transmitter for transmitting signals to at least one 
remote video camera, and a second transmitter for transmitting 
1 5 packaged signals to the main processor, 

each one of the plurality of remote video camera 
interfaces comprising a receiver associated with each of the 
plurality of remote video cameras, a controller associated with 
each receiver for controlling transmissions from one remote video 
20 camera, and a memory for storing the transmissions: and 

a video camera having a communication hub interface for 
communication with the communication hub, the video camera 
comprising a transmitter, a receiver, and a controller for controlling 
communication with the communication hub. 

25 

12. The machine vision control system of claim 1 1 further including at least 
one analog video camera connected to the communication hub. 

13. A main processor for bi-directional high speed digital serial 

30 communication in a machine vision control system having a plurality of remote 
video cameras, the main processor comprising; 
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a receiver for receiving packaged digital video data or control 
signals including a header; 

a controller for separating the header from the digital video data 
or control signals; 

a memory for storing the digital video data or control signals; and 

a transmitter for transmitting packaged digital signals including a 
header in response to the received packaged digital video data or control 
signals. 



10 14. A video camera interface for bi-directional high speed digital serial 

communication in a machine vision control system between a plurality of remote 
video cameras and a processor, the video camera interface comprising; 

a receiver for receiving packaged digital signals from the 
processor; 

1 5 a transmitter for transmitting packaged digital transmissions 

comprising a header and either digital video data or digital control 
signals; and 

a controller for controlling communication with the processor. 

20 15. A communication hub for bi-directional high speed digital serial 

communication in a machine vision control system between a plurality of remote 
video cameras and a processor, the hub comprising; 

a processor interface connected to the processor; and 
a plurality of remote video camera interfaces connected to the 
25 plurality of remote video cameras; 

the processor interface comprising a receiver for receiving 
digital transmissions from the main processor, a first transmitter 
for transmitting signals to at least one remote video camera, and a 
second transmitter for transmitting packaged signals to the main 
30 processor; 

each one of the plurality of remote video camera 
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interfaces comprising a receiver associated with each of the 
plurality of remote video cameras, a controller associated with 
each receiver for controlling transmissions from one remote video 
camera, and a memory for storing the transmission. 



16. The communication hub of claim 15 further including a control 
for directly communicating with at least one input/output device. 



circuit 



1 7. A method of bi-directional communication in a machine vision control 
system between a plurality of remote video cameras and a main processor, the 
method comprising the steps of; 

serially transmitting digital signal packets comprising digital data 
or control signals, and a first header from the remote video cameras to a 
communication hub; 

using the communication hub, multiplexing the digital signal 
packets from the remote video cameras, evaluating a destination address 
identifier included in the first header, and transmitting at least some of 
the digital signal packets to the main processor; 

serially transmitting digital signal packets including a 

second header from the main processor to the communication 

hub; and 

using the communication hub, evaluating a destination address 
identifier included in the second header, and transmitting at least some of 
the packets to at least one the remote video cameras. 

1 8. The method of claim 1 7 further including the steps of; 

transmitting a high priority digital signal packet comprising a 
header having a high priority identifier from a camera to the 
communication hub; 

interrupting a digital signal packet being transmitted by the 
communication hub to the main processor in response to the high priority 
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digital signal packet and transmitting the high priority digital signal 
packet from the communication hub to the main processor; and 

completing the transmission of the interrupted digital signal 

packet. 

5 

1 9. The method of claim 1 7, further including the steps of; 

transmitting a digital signal packet from one of the remote video 
cameras where the destination address is an address corresponding to the 
communication hub; 

1 0 evaluating the destination address identifier at the communication 

hub; and 

responding to the digital signal packet with the communication 

hub. 

1 5 20. A method of bi-directional communication in a machine vision control 
system between a plurality of remote video cameras and a main processor, the 
method comprising the steps of; 

serially transmitting digital signal packets comprising digital 
video data or control signals from the remote video cameras to a 

20 communication hub to the main processor. 

where the digital video data signals comprise a source address 
code for identifying an address origin of the digital video data 
signal, a destination address code identifying a final address 
destination of the digital video data signal, and digital video data. 

25 and the digital control signals comprise a source address code for 

identifying an address origin of the digital control signal, a 
destination address code identifying a final address destination of 
the digital control signal, and digital control commands; and 
serially transmitting digital signal packets from the main 

30 processor to the remote video cameras. 
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21 . A communication protocol in a machine vision control system for 
transmissions between a plurality of remote video cameras and a main processor, 
the protocol comprising; 

a beginning code indicating a beginning of a transmission; 

a source address indicating an address of the transmission origin; 

a destination address indicating a destination of the transmission; 

data or control codes; and 

an ending code indicating the end of the transmission. 
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